Audiovisual integration in speech perception

Modeling the Development of Audiovisual Cue Integration in Speech Perception

Adult speech perception is generally enhanced when information is provided from multiple modalities. In contrast, infants do not appear to benefit from combining auditory and visual speech information early in development. This is true despite the fact that both modalities are important to speech comprehension even at early stages of language acquisition. How then do listeners learn how to proc...

Dynamic Modeling Approaches for Audiovisual Speech Perception and Multisensory Integration

Multimodal information including auditory, visual and even haptic information is integrated during speech perception. Articulatory information provided by a talker‘s face enhances speech intelligibility in congruent and temporally coincident signals, and produces a perceptual fusion (e.g. the ―McGurk effect‖) when the auditory and visual signals are incongruent. This paper focuses on promising ...

Audiovisual Integration in Speech Processing

Prediction and constraint in audiovisual speech perception.

During face-to-face conversational speech listeners must efficiently process a rapid and complex stream of multisensory information. Visual speech can serve as a critical complement to auditory information because it provides cues to both the timing of the incoming acoustic signal (the amplitude envelope, influencing attention and perceptual sensitivity) and its content (place and manner of art...

Uncertainty and attention in audiovisual speech perception

This study deals with uncertainty and attention in audiovisual speech perception. Subjects were exposed to audiovisual stimuli where independent variable was bivalent: either blocked to one ear or uncertainty about in which ear the next stimulus would appear. The hypothesis, that uncertainty would inhibit audiovisual integration was motivated by an earlier study (Öhrström et al, 2011) but these...